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Analogue  electronici  appears  to  offer  the  most  direct  way  to  mimic  the  informa¬ 
tion  processing  which  occurs  in  the  dendrites  of  neurons.  Unfortunately,  analogue 
electronics  suffers  from  a  restricted  dynamic  range,  a  problem  which  also  occurs  in 
neurons.  The  study,  reported  in  this  memorandum,  was  therefore  initiated  to  under¬ 
stand  how  biological  neiiral  systems  overcome  the  problems  inherent  in  employing 
components  with  an  inadequate  dynamic  range.  The  inadequacy  of  the  dynamic 
range  available  in  neurons  is  most  apparent  in  retinas  which  deal  with  an  input 
signal  covering  5  decades  using  components  with  a  dynamic  range  of  lest  than  2 
decades.  The  ‘predictive’  enco^ng  hypothesis  which  hat  been  proposed  to  explain 
the  function  of  the  outer  retina  it  adopted  at  a  framework  for  understanding  the 
"neurological  data  discussed.  Then,  three  different,  independently  evolved,  retinas 
are  considered  to  demonstrate  the  different  implementations  of  the  tame  xmderlying 
principle.  The  study  shows  that  the  problems  posed  by  the  limited  dynamic  range 
available  in  both  neurons  and  analogue  electronics  can  be  overcome  if  the  system  is 
correctly  designed.  It  also  demonstrates  thct  the  McCulloch- Pitt  model  of  a  neuron, 
which  forms  the  basis  of  artificial  neural  networks,  it  an  incomplete  model. 
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1  Introduction 


A  prcvioul  study  of  information  processing  in  the  brain[i]  suggested  that  at  least  some  of 
tills  information  processing  occurs  within  the  dendrites  of  neurons.  In  dendrites  information 
is  almost  exclusively  represented  as  a  continuous  electrotonic  potential.  This  observation, 
combined  with  fact  that  the  widely  used  model  of  a  dendrite  is  the  cable  equation[l], 
also  used  to  model  metal  tracks  on  integrated  circuits,  suggests  that  dendritic  information 
processing  is  most  directly  mimicked  by  analogue  electronics. 

Unfortunately,  analogue  electronics  relies  upon  the  ability  to  fabricate  large  numbers 
of  identical  devices.  In  practice  there  are  variations  in  any  population  of  devices,  leading 
to  a  minimum  significant  voltage  difference.  This  combines  with  the  maximum  allowed 
voltage  difference  arising  from  the  power  supply  to  restrict  the  dynamic  range  available 
in  <^n  analogue  circuit.  The  dynamic  range  of  analogue  circuits  can  be  increased  at  the 
cost  of  employed  more  area.  However,  in  achieving  8*bit  equivalent  resolution  an  analogue 
approach  losses  its  advantage  of  compactness  when  compared  to  a  digital  implementation!^. 
To  maintain  the  advantage  of  compactness  an  analogue  system  must  tolerate  a  dynamic 
range  smaller  than  that  available  in  a  digital  system. 

Fortunately,  biological  neural  networks  have  evolved  to  tolerate  the  small  dynamic  range 
available  in  neurons.  The  study  reported  in  this  memorandum  was  therefore  initiated  to 
discover  how  the  biological  neural  networks  have  adapted  to  the  limitations  arising  from 
the  use  of  analogue  signals  in  neurons.  Understanding  the  information  processing  which 
is  occurring  within  the  neural  systems  is  a  prerequisite  to  a  study  into  how  these  systems 
overcome  the  limited  dynamic  range  available  within  their  components.  This  prerequisite 
naturally  leads  to  a  study  of  sensory  systems,  which  have  been  studied  in  detail  and  can  be 
understood  in  terms  of  the  characteristics  of  the  information  they  receive.  A  particularly 
well  studied  sensory  system  is  the  retina.  There  are  several  reasons  why  the  retina  is  a  good 
subject  for  the  present  study: 


•  There  is  a  theoretical  basis  for  interpreting  the  information  processing  which  occurs 
within  a  retina. 

•  There  is  a  sever  dynamic  range  problem  in  retinal  cells.  The  signals  received  by  the 
retina  have  a  dynamic  range  of  10*.  This  signal  is  processed  by  the  retina  despite 
the  fact  that  none  of  its  component  neurons  has  such  a  large  dynamic  range,  in  fact 
the  output  neurons  only  operate  over  one  decade[3].  The  result  is  that  at  any  instant 
the  eye  can  only  distinguish  levels  of  illumination  which  differ  by  up  to  2%  from  the 
overall  mean  level’. 

•  The  retina  performs  data  compression.  The  fact  that  the  retina  greatly  reduces  the 
bandwidth  required  to  transmit  the  data  it  receives  is  indicated  by  the  fact  that 
the  human  eye  transmits  the  Information  from  10*  receptors  using  an  optic  nerve 
containing  only  10*  fibers. 

t  All  this  retinal  information  processing  is  performed  using  local  connections,  Similar 
techniques  may  therefore  be  suitable  for  for  implementation  in  analogue  electronics. 

'  This  ebUily  to  cep*  with  a  r«itriet«d  dynamic  tang*  Is  the  reason  why  Mead  ehoat  to  aaimic  iht  retina  In 
*Uicon[4].  Expressed  In  his  terms,  the  retina  previdn  a  model  Iht  aolomatic  gain  control  applied  In  analogue 
eircuiti  lo  extend  Iheir  usefiil  operating  range. 
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The  memomndum  begini  with  a  desd^tion  of  a  theory  which  hat  been  propoied  to 
explain  retinal  information  proceiiing.  Thii  ii  followed  by  a  diicuiiion  of  three  very  different 
retinal  in  lectioni  3,  4  and  5.  Theie  ihort  deieriptioni  outline  the  general  applicability 
of  thii  theory  and  the  different  neural  'implementationi'  which  have  been  adopted.  The 
implication!  of  these  findings  are  then  discussed  in  section  6.  For  completeness  there  is 
an  appendix  discussing  retinal  gain  control,  an  alternative  theory  of  retinal  information 
processing. 


2  A  Theory  of  Retinal  Information  Processing 

In  studies  of  retinal  structure  neurons  are  described  in  terms  of  the  part  of  the  field  of  view 
to  which  they  react,  their  receptive  field.  It  is  frequently  found  that  these  receptive  fields 
consist  of  two  components  a  ‘centre’  and  ‘surround*,  supplied  via  neighbouring  receptors. 
These  two  components  have  opposite  effects  on  the  ‘target’  neuron  corresponding  to  the 
receptive  field.  For  example,  a  target  neuron  may  be  excited  by  the  input  from  the  centre 
of  its  receptive  field  and  inhibited  by  inputs  from  the  surround.  Neurons  with  this  type 
of  receptive  field  respond  to  the  difference  between  the  excitatory  and  inhibitory  inputs 
and  arc  said  to  posses  an  antagonistic  centre-surround  receptive  field.  Any  theory  of  retinal 
information  processing  must  explain  the  widespread  occurrence  of  neurons  with  antagonistic 
centre-surround  receptive  fields  *. 

There  have  been  several  proposals  attempting  to  explain  the  function  of  antagonistic 
centre-surround  receptive  fields  in  the  retina[5].  These  have  included: 

•  Attenuation  of  low  frequencies  components  of  the  input  signal.  When  originally  pro¬ 
posed  it  was  thought  that  the  motivation  for  this  filtering  would  be  to  compensation 
for  optical  blurring  of  the  images.  However,  this  hypothesis  does  not  appear  to  be 
supported  by  later  evidence.  More  recently  it  has  been  proposed  that  low  frequency 
attenuation  is  employed  to  enhance  edges,  an  important  feature  in  images.  Units  with 
antagonistic  centre-surround  fields  enhance  edges  by  performing  an  operation  some¬ 
times  referred  to  as  a  difference  of  Gaussians  which  can  be  used  as  an  approximation 
to  a  Laplacian  filter.  Laplacian  filters  are  widely  used  in  vision  data  processing  to 
enhance  edges  to  help  object  deflnition[4]. 

•  Removal  of  unspecified  redundant  information. 

•  Removing  any  d.c.  bias  in  the  signals.  However,  this  is  a  qualitative  hypothesis  from 
which  it  is  difficult  to  determine  the  neighbourhood  over  which  the  bias  should  be 
calculated. 

Since  all  these  proposals  depend  to  some  degree  on  the  filtering  properties  of  an  lAtag- 
onistic  centre- surround  receptive  fieid  it  is  possible  that  all  these  functions  are  performed. 

A  more  detailed  hypothesis  has  been  proposed  by  Srlnivasan,  LaughUn  and  DubsjS]. 
These  authors  have  suggested  that  the  retina  is  removing  the  linearly  predictable  spatial 

’Any  ihtory  which  docs  ciptaln  anls|onisltc  ctnlre-sunound  receptive  fields  may  have  an  linpaet  beyosid 
'  the  retina.  Neurons  respondini  to  antaionistie  centre-surrounds  have  beca  tdeatified  thre«|heut  the  visual 
system.  More  gcneraliy  ants|onisllc  cent  re-surround  k  simply  one  (bm  of  lateral  lahibltien  chserved  In 
many  parts  of  the  brain. 
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nnd  temporal  correlations  from  the  input  signal,  using  a  technique  which  they  refer  to  as 
'predictive'  coding.  The  authors  suggest  that  this  correlation  removal  is  achieved  when 
0  prediction  of  the  signal  strength  is  subtracted  from  the  signal.  This  removes  spatial 
and  temporal  correlations  if  the  'prediction'  is  bstted  upon  the  previous  value  of  the  signal 
at  a  point  and  in  its  neighbourhood.  The  advantage  of  employing  this  technique  is  that 
redundant  information,  concerning  predictable  components,  can  be  removed  from  the  signal. 
The  resulting  'error'  signal  can  then  be  represented  in  a  smaller  dynamic  range  *. 

To  enable  a  comparison  between  this  theory  and  neuroblologlcal  results  Srinivasan, 
Laughlin  and  Dubs  studied  the  dependence  of  the  theoretical  ‘best’  neighbourhood  on  the 
spatial  correlations  in  the  image  and  the  signal*to-noise  ratio[i^.  They  found  that  the  'best' 
neighbourhood  is  insensitive  to  the  spatial  correlations  in  the  image.  This  it  an  important 
result  wliich  suggests  that  the  retina  will  not  be  required  to  adapt  to  specific  scenes.  In 
contrast,  the  ‘best*  neighbourhood  was  found  to  be  sensitive  to  the  signal-tO'  noise  ratio. 
The  theory  suggests  that  the  smaller  the  signal-to<noise  ratio  the  larger  the  neighbourhood 
which  shou.d  be  used  in  a  'prediction'.  This  enlarging  of  the  neighbourhood  can  be  in¬ 
terpreted  as  an  attempt  to  reduce  noise  by  increasing  the  sample  site.  Since  low  levels  of 
illumination  correspond  to  small  signal- to> noise  ratios,  due  to  a  large  photonic  (shot)  noise 
component,  the  hypothesis  suggests  that  low  levels  of  illumination  will  correspond  to  large 
neighbourhoods.  The  'predictive'  encoding  hypothesis  can  therefore  be  tented  by  studying 
the  dependence  of  the  neighbourhood  on  the  level  of  illumination 

Predictive  encoding  can  aiso  be  used  to  remove  temporal  correlations[6].  These  temporal 
correlations  arise  from  one  of  two  sources,  spatial  correlation  in  a  slowly  changing  scene  or 
the  finite  response  time  of  the  photodetection  process  in  a  rapidly  changing  scene.  Temporal 
'prediction  relies  upon  a  weighted  sum  of  previous  signals  at  the  same  point.  Although 
there  are  differences,  arising  from  the  continuous  nature  of  temporal  sampling  compared 
to  discrete  spatial  sampling,  the  theories  for  spatial  encoding  and  temporal  encoding  are 
very  similar.  Again  the  main  result  is  that  at  the  noise  level  increases  the  time  over  which 
the  prediction  is  made  increases,  in  an  attempt  to  reduce  the  noise.  The  theory  therefore 
predicts  that  as  noise  increases  the  system  will  trade  speed  for  accuracy. 

Predictive  encoding  seems  plausible  and  encompasses  some  of  the  earlier  theories.  It 
both  indicates  that  the  redundancy  which  is  removed  is  any  predictable  components,  in 
both  space  and  time,  and  gives  a  technique  to  determine  the  neighbourhood  over  which 
to  calculate  a  'd.c.  bias'.  Aiso,  the  coimectivities  required  for  proactive  coding  and  edge 
enhancement  are  very  similar.  The  difference  between  these  two  approaches  is  simply  one 
of  underlying  philosophy.  Predictive  encoding  is  based  on  the  qualities  of  images,  whilst 
edge  enhancement  is  a  feature  extraction  technique  based  on  the  perceived  importance  of 
a  specific  feature. 

The  predictive  encoding  hypothesis  is  interesting  because  It  takes  as  its  starting  pobt  the 
general  properties  of  the  input  signal  and  a  desire  to  employ  a  restricted  dynamic  range.  This 
then  leads  to  'operations’  which  could  explain  the  antagonistic  centre>surr0und  receptive 
fields  observed  In  the  retina*.  To  be  fully  accepted,  the  predictive  encoding  hypothesis 

'* Kn  •J«rns(lvf  inlcrprctstion  of  this  Ischniqus  is  that  it  a  ealculatM  a  'local'  mean.  This  local  mean 
can  then  b«  treated  as  a  d.c.  ofliMt  which  ii  subtracted  from  the  signal. 

‘Ai  an  csample  of  the  neighbourhoodt  requiiedf  for  a  signal-lo-aoise  ratio  of  10  the  1**  nearest  neighboers 
are  required,  a  ratio  of )  requires  a  neighbourhood  Including  nearest  I  neighbours  and  a  ratio  of  0.1  requirtt 
a  glob^  mean. 

‘The  motivation  to  reduce  the  dynamic  range  is  sullicisnlty  ..neral  that  predktivt  sncodfaii  mair  rep- 
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needs  to  be  tested  Against  detailed  neurological  results.  To  this  end  LaughlJn  has  continued 
to  study  the  fly  retina[6].  Some  of  his  results  are  outlined  in  the  following  section. 


S  The  Fly  Eye 


The  eye  of  a  fly  is  a  compound  eye  formed  froin  a  hexagonal  array  of  uniti  known  as 
onunatidia,  littlt  tyes.  There  arc  various  forms  of  compound  eyes  found  in  diflTerent  insects. 
The  fly  eye  is  one  of  a  class  of  compound  eyes  in  which  each  ommatidlum  is  optically  isolated 
by  pigmentation[7].  The  result  of  this  isolation  is  that  the  photodetectors,  the  r^bdoms, 
only  receive  light  via  the  aperture  of  the  ommatidium  in  which  they  are  situated.  Within 
the  fly  eye  each  ommatidium  contains  eight  different  detectors.  These  form  a  cluster,  with 
six  peripheral  detectors,  known  at  Rl>R6,  surrounding  two  central  detectors  organised  with 
one,  R8,  behind  the  other,  R7.  The  outer  surface  of  each  ommatidium  it  faceted  in  such 
a  way  that  within  each  ommatidium  one  of  the  peripheral  detectors  looks  in  the  tame 
direction  at  the  central  detectors  in  one  of  the  six  neighbouring  onunatidia. 

To  form  an  image  the  inputs  from  all  the  peripheral  receptors  which  are  stinnilated  by 
the  tame  point  in  the  field  of  view  are  superposed  *.  This  superposition  of  stimuli  from 
the  Rl*R6  neurons  occurs  within  a  hexagonal  array  of  cartridges  in  a  structure  known  as 
the  lamina.  Each  cartridge  in  the  lamina  contains  the  tame  types  of  neurons,  organised  to 
a  common  pattern,  and  it  it  separated  from  its  neighbours  by  a  sheath  of  glial  cells.  It  is 
this  regular  structiue  which  makes  the  fly  eye  an  accessible  subject.  The  projection  of  the 
receptor  neurons  to  the  cartridges  it  not  fortuitous,  each  neuron  undergoes  a  twist  through 
180°  to  compensate  for  image  inversion.  This  complex  mapping  of  receptor  inputs  onto  the 
lamina  has  the  property  of  retaining  the  relative  positions  of  the  points  in  the  field  of  view^. 

A  full  discussion  of  the  fly  eye  would  be  prohibitively  lengthy.  In  hit  studies  Laughlin[6] 
hat  concentrated  upon  the  system  formed  by  the  R1>R6  photosensitive  neurons  and  the 
two  large  monopolar  cells,  Ll  and  L2,  referred  to  at  the  LMCt,  within  each  cartridge*.  By 
concentrating  upon  these  neurons  the  extent  of  the  present  discussion  can  be  restricted. 

When  this  group  of  neurons  was  studied,  it  was  found  that  both  the  photoreceptors  and 
the  LMCt  employ  continuously  varying  electrotonic  potential  signals.  Experiments  indi¬ 
cate  that  the  photoreceptor  cells  generate  a  transient  response  to  stimulation  followed  by  a 
plateau  dependant  upon  the  illumination  level.  The  photoreceptors  are  not  therefore  fully 

reMol  the  Aindamcalal  principU  undtdylni  Ih*  widespread  um  lateral  iaUbltioB  in  amoa  populatloni. 

*lDter^elln|lr,  the  central  detectors  do  aot  appear  to  take  part  la  Uds  coamgeace.  This  sagiests  that 
the  fly  has  two  detector  systenu  working  in  paralleli  a  high  intensity,  Ugh  resolntion  (the  centre  waveguide 
is  nahower  than  the  others)  system  and  a  low  inteiuity,  low  resolution  system[T].  However,  them  Is  strong 
evidence  thst  the  R1*R8  neurotu  ore  necessary  fat  tasks  foe  whidi  the  R7  and  Rl  neurons  appear  to  be 
adapted[l].  The  role  of  the  Rl>Rf  neurons  may  be  explained  by  the  discovery  of  a  small  area  of  the 
cartridge  in  wUch  the  R7  and  Rl  cells  connect  to  the  Rl  cell  In  the  cartr{dgc(l]. 

'This  mapping  means  that  the  cartridges  arc  the  first  layer  at  which  the  eye  forms  an  image  of  the  field  of 
view.  In  this  important  respect  they  correspond  to  the  rods  and  conn  in  a  refracting  eye,  such  u  a  human 
eye. 

'  An  interesting  quHtion  wUeh  Is  not  directly  related  to  the  current  topic  b|  Why  are  their  two  apparently 
identical  LMO  cells?  The  answer  appears  to  be  related  to  the  fleet  that  the  eeUs  ate  not  Identical  but  have 
dUferent  tUcknesscs.  The  theory  of  signal  propagation  in  axons  luggesls  that  Uiis  means  they  have  dilforent 
signal  propagation  velocities.  BrallenbergllO]  has  suggeilcd  that  these  cells  could  he  used  u  delay  linn  in 
a  motion  detector.  No  supporting  evidence  It  given  for  this  hypolhcsii. 
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light  adapted.  However,  the  traniient  retpontei  obterved  do  indicate  that  the  photorecep¬ 
tors  arc  using  a  slow  time-constant  and  self-inhibition  to  reduce  the  average  level  of  activity 
by  removing  temporal  correlations  from  the  input. 

The  important  observations  concerning  the  subsequent  conversion  of  the  signal  from  the 
receptors  to  the  LMCs  are  that  the  signal  is  inverted,  amplified  and  has  extra  transients 
introduced.  The  inversion  of  the  signal  is  insignificant.  However,  considerable  effort  is  in¬ 
volved  in  its  amplification.  Both  the  receptors  and  the  LMCs  have  a  relatively  small  range 
of  accessible  membrane  potentials,  dynamic  range.  Without  an  adaptation  mechanism  the 
LMCs  would  be  restricted  to  encoding  signals  over  2  decades  compared  to  the  5  decades  re¬ 
quired  in  conditions  ranging  from  twilight  to  bright  sunlight.  The  LMC  response  is  therefore 
adapted  so  that  a  constant  backgrotind  Is  represented  by  the  same  potential  independent  of 
its  intensity.  Any  change  in  the  background  is  then  represented  by  transients  which  decay 
within  a  few  hundred  milliseconds.  It  is  this  adaptation  to  the  average  illumination  level 
which  causes  the  extra  transient  nature  of  the  signals  observed  in  the  LMCs.  These  cells 
also  adapt  by  decreasing  the  leakage  current  out  of  the  cell  in  response  to  decreased  illu¬ 
mination  levels.  The  result  is  that  the  integration  time  used  by  the  cell  is  increased.  Thus 
accuracy  is  increased  as  the  cost  of  reduced  speed,  in  line  with  the  prediction  based  on  the 
predictive  encoding  hypothesis  in  section  2. 

Laughlin  considers  the  signal  processing  involved  in  transmitting  information  from  the 
photoreceptor  to  the  LMCs  as  occurring  in  three  stages;  A  photoreceptor  response  related 
to  the  logarithm  of  the  stimulus,  followed  by  subtraction  and  amplification.  The  logarith¬ 
mic  response  arises  from  the  use  of  a  photoreceptor  mechanism  which  combines  non-linear 
summation  of  conductance  events  and  a  gain  which  reduces  with  illiunination[ll].  This 
step  is  significant  in  reducing  the  calculation  of  ratios,  involved  in  contrast  calculations,  to 
subtraction.  Therefore,  as  well  as  reducing  the  dynamic  range  of  the  signal,  the  first  two 
Stages  of  the  transmission  process  ensure  that  the  photoreceptors  encode  the  contrast  in 
the  scene[ll].  This  contrast  encoding  has  the  advantage  that  it  eliminates  the  effect  of  the 
overall  level  of  illumination  when  objects  are  observed  by  reflection.  Thus  ensuring  that  an 
object  appears  the  same  under  all  illumination  conditions. 

It  is  at  the  second,  subtraction,  stage  of  the  transmission  process  that  predictive  encod¬ 
ing  may  be  occurring.  This  stage  reduces  the  signal  to  the  smallest  dynamic  range  possible 
within  the  constraints  imposed  by  the  ‘wetware’.  Then  this  signal  is  amplified  so  that  the 
entire  dynamic  range  avsulable  in  the  LMC  is  employed.  This  process  ensures  that  the 
amplified  signal  is  as  robust  as  possible  against  noise.  The  amplification  of  the  signal  actu¬ 
ally  occurs  at  a  chemical  sjmapse  which  is  the  dominant  noise  source  in  the  system.  Since 
the  level  of  amplification  possible  is  limited  by  the  restricted  dynamic  range  of  the  LMCs, 
.Information  Theory  suggested  that  matched  coding  should  be  used  to  optimise  the  level  of 
amplification.  Shannon  and  Weaver  proved  that  a  limited  number  of  symbols  carried  the 
maximum  of  information  if  each  symbol  is  used  equally  often  (the  equivalent  technique  used 
in  digital  signal  processing  is  histognm  eqfialuaiion).  Laughlin  proved  that  the  LMCs  used 
matched  coding  by  demonstrating  that  the  intensity-response  function  of  the  LMCs  is  the 
cumulative  distribution  of  the  contrast  in  the  scene.  To  match  the  intensity-response  curve 
to  its  environment  the  system  requires  a  mechanism  to  generate  a  logistic  intensity-response 
curve  and  adapt  the  slope  at  the  mid-point  to  the  contrast  distribution  in  the  current  image. 
In  fact  this  type  of  behaviour  is  widespread  in  retinas*.  Analysis  of  the  behaviour  of  LMCs 

’It  it  sufficiently  common  to  form  the  basis  of  a  separate  theory  of  retina  adaptation  proposed  by  Shapley 
and  Enroth-Cugell,  which  is  discussed  in  appendix  A. 


indicates  that  the  non'linearity  in  the  synaptic  transmission  process  is  suflicient  to  account 
for  the  matched  coding  behaviour. 

As  stated  previously,  the  problem  with  any  subtraction  process  is  to  determine  how  to 
calculate  the  value  to  be  subtracted  from  the  signal.  A  global  mean  could  be  used,  but  this 
would  not  account  for  local  variations  in  the  illumination  levels.  The  predictive  encoding 
hypothesis  is  useful  in  determining  the  neighbourhood  over  which  the  'mean'  should  be 
calculated.  Once  the  prediction  is  subtracted  from  the  actual  value  the  dynamic  range  of 
the  signal  will  be  reduced  without  loss  of  information*®. 

Having  identified  the  neurons  of  interest  and  the  signals  observed  in  the  neurons,  a  com¬ 
plete  knowledge  of  their  synaptic  connections  is  reqtiired  to  understand  how  these  signals 
arise  **.  Fortunately  there  appears  to  be  strong  evidence  for  all  the  connections  of  interest 
between  these  neurons.  It  has  been  observed  that  as  they  approach  the  lamina  the  R1-R6 
neurons  forrh  a  circular  bundle  prior  to  forming  a  ‘crown’  around  the  two  LMC  neurons, 
Ll  and  L2  [8].  Within  the  crown  each  of  the  R1-R6  neurons  is  connected  to  its  two  neigh- 
botirs  in  the  circle  by  numerous,  approximately  60,  gap  junctions  and  to  each  LMC  cell  by 
approximately  220  chemical  synapses[l2].  Since  the  responses  of  the  R1-R6  cells  are  super¬ 
posed  within  the  LMC  cells  the  discovery  of  these  gap  junctions  was  a  surprise.  Another 
surprise  was  the  fact  that  despite  the  strong  evidence  for  lateral  inhibition  between  LMC 
cells  there  is  no  evidence  for  the  existence  of  gap  junctions  to  mediate  this  interactlon[9].  It 
now  appears  that  the  observed  lateral  Inhibition  arises  from  variations  in  the  local  potential 
field  in  the  lamina.  Since  local  potential  variations  are  difficult  to  generate  and  sustain 
in  large  systems  this  mechanism  immediately  explains  why  the  lamina  has  evolved  to  be  - 
electrically  isolated  from  both  the  ommatidia  layer  and  the  rest  of  the  brain[l3].  It  appears 
that  this  local  potential  arises  from  synapses  which  have  been  observed  between  some  of 
the  a  and  0  neurons  in  the  cartridge  and  the  glial  cells  which  surround  the  cartridge.  Since 
coupling  between  glial  cells  is  a  rule  rather  than  an  exception,  there  is  the  potential  for  the 
glial  cells  to  behave  like  a  network  of  resistors.  (This  type  of  network  has  been  extensively 
studied  and  employed  artificial  retinas  to  calculate  local  average  potentials[4].)  Thus  the 
glisd  cells  may  generate  a  local  potential  dependant  upon  the  local  neural  activity.  This 
local  potential  is  then  subtracted  from  the  instantaneous  receptor  potential  by  a  change  of 
potential  reference.  The  overall  result  is  that  the  LMCs  are  stimulated  by  the  difference 
between  the  receptor  neurons  potential  and  a  local  potential.  Thus,  the  coupling  between 
glial  cells  and  the  electrical  isolation  of  the  lamina  seem  to  provide  the  substrate  for  the 
"  removal  from  the  signal  of  spatial  correlations. 

The  ‘wetware’  needed  to  encode  the  signal  therefore  exists  in  the  lamina.  As  stated  pre¬ 
viously  the  shape  of  the  surround  required  to  perform  the  predictive  coding  is  not  critically 
dependant  upon  the  spatial  correlations  of  the  scene.  However,  it  is  critically  dependant 
upon  the  noise  induced  in  the  photoreceptors.  Under  conditions  of  high  illumination  the 
predictive  encoding  hypothesis  suggests  that  the  nearest  neighbours  can  be  reUed  upon  to 
generate  a  reliable  prediction.  However,  as  the  illumination  level  decreases  the  number  of 
receptors  which  should  be  included  in  the  averaging  process  should  increased.  In  physiologi¬ 
cal  terms  this  means  that  the  lateral  antagonism,  on  which  the  centre-surround  organisation 

"’Information  ii  not  lost  af  long  as  the  method  of  encoding  is  known.  In  artiAeial  systems  the  method 
of  encoding  b  part  of  the  transmitted  signal.  In  hardware  this  b  unnecessary  as  long  as  (he  method  I'l 
unchanged. 

"Experiments  to  determine  synaptic  connections  are  difficult  to  pcrform[9],  resulting  in  a  continuous 
review  of  the  evidence  for  the  various  synaptic  connections. 
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is  bftsfd,  should  become  wc&ker  and  more  widespread  as  the  illumination  level  is  reduced. 
This  type  of  effect  hat  been  observed  A  more  detailed  analysis  of  the  lamina  shows  that 
the  antagonism  present  it  more  widespread  than  expected  from  the  predictive  encoding 
hypothesis.  Laughlin  hat  postulated  that  this  effect  is  accounted  for  by  the  fact  that  the 
eye  it  attempting  to  encode  moving  images. 

Laughlin  hat  put  forward  a  convinebtg  cate  supporting  the  suggestion  that  the  predictive 
encoding  hypothesis  can  be  used  to  interpret  the  information  processing  occurring  in  the  fly 
retina.  However,  the  genera]  applicability  of  the  hypothesis  can  only  be  tested  by  studying 
other  retinas.  To  this  end  two  other  retinas  are  described  in  the  following  sections. 


4  The  Vertebrate  Retina. 


The  vertebrate  retina,  shown  in  figure  (1),  is  more  complex  than  the  fly  retina.  However  its 
position  and  structure,  a  small  variety  of  cells  organised  in  layers,  make  it  a  relatively  easy 
subject  to  study.  In  the  vertebrate  retina  there  are  two  types  of  photodetectors,  the  rods 
and  the  cones.  The  remainder  of  the  retina  is  made  up  of  four  other  types  of  cells  known  as 
the  bipolar,  horizontal,  amacrine  and  ganglion  ceU8{14].  Each  population  of  detector  cells 
performs  a  separate  fimction:  The  rods  are  responsible  for  vision  at  low  illumination  levels, 
whilst  the  cones  are  responsible  for  high  acuity,  colour  vision  at  high  illumination  levels*?. 
In  general,  the  bipolar  cells  connect  the  photoreceptor  cells  to  the  ganglion  cells  which  form 
the  output  from  the  retina.  The  other  two  types  of  cells  spread  laterally  throughout  the 
retina  forming  ideal  communication  pathways.  Of  these  different  cell  t3rpes  in  the  retina 
action  potentials  only  conrimonly  occur  in  ganglion  cells,  with  infrequent  occurrence  in 
amarcine  cel]s[l6].  The  information  processing  of  interest  therefore  occurs  in  cells  which 
employ  electrotonic  potentials. 

Unforttinately  this  classification  into  five  cell  types  may  be  too  simplistic.  It  is  now  clear 
that  there  are  distinct  types  of  amarcine  cells  distinguished  by  morphology,  arborisation, 
chemistry  and  responses.  Their  precise  role  is  unknown  but  they  appear  to  be  concerned 
with  movement  detection  and  directional  sensitivity.  To  limit  the  scope  of  the  present 
discussion  details  concerning  the  structure  and  function  of  amarcine  cells  will  be  onutted. 

The  easiest  cells  in  the  retina  to  study  are  those  cells  whose  axons  form  the  output 
of  the  retina,  the  ganglion  cells  Studies  indicate  that  the  ganglion  cell  receptive  fields 
have  large  overlaps  so  that  even  a  small  spot  causes  a  response  in  several  ganglia.  As 
with  the  cartridges  in  the  fly  lamina,  the  ganglion  cells  are  organised  to  form  a  map  of  the 
field  of  view.  The  importance  of  this  mapping  for  information  processing  is  emphasised 
by  the  fact  that  it  is  preserved  by  the  projections  of  the  ganglion  cells  to  the  brain.  The 
antagonistic  centre-surround  nature  of  the  ganglion  cell  receptive  fields  was  discovered  using 
spot  stimuli[l4].  There  appear  to  be  two  lormj  of  antagonism  used  by  ganglion  cells.  Cells 

‘^Barlow  itatei  that  the  conei  each  have  their  own  direct  eonaeetion  to  the  optic  nerve.  In  this  respect 
the  cones  are  appear  to  be  similar  to  the  RT  and  R8  neurons  the  fly  retina. 

’’There  are  two  main  categories  of  ganglion  cells,  referred  to  as  X-ecUi  and  Y*cclls,  which  are  characterised 
by  di/Tering  respoiues  to  stimuli.  It  would  appear  that  the  X-cells  concentrate  on  output  from  the  fovea  and 
are  responsible  for  high-acuity  vision  whilst  the  Y-cells,  which  concentrate  upon  output  from  the  periphery, 
are  primarily  motion  detectors[]6].  In  animals  with  a  colour  vision  it  is  the  population  of  X-cells  which 
contain  colour  specific  ganglion  cells. 
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Figure  1:  A  section  through  a  primate  retina:  Figure  (la)  shows  the  relationship  between 
the-various  cell  types.  The  rods  (R)  and  cones  (C)  connect  vertically  to  the  ganglion  cells, 
(G),  via  the  bipolar  cells,  (B),  whilst  the  horitontal,  (H),  and  amacrine,  (A),  cells  interact 
laterally.  The  triad  synapse  is  encircled,  this  is  the  point  at  which  the  rods  reaction  with 
the  bipolar  cell  is  mediated  by  the  horizontal  cell.  Figure  (lb)  shows  the  detail  of  the  triad 
synapse  to  emphasis  the  interaction  between  the  rod  and  the  dendrites  of  both  the  bipolar 
and  horizontal  cells.  (Reproduced  with  permission  from  reference  [15]) 
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referred  t<»  ft!i  on-centre  celli  reipond  with  im  incrcMed  firing  rnle  when  their  centre  n 
illimiinAtcd.  In  contrail  oIT'Ccntre  celli  reipond  to  illmului  by  flowing  their  firing  rate. 

Detailed  sludici  indicate  that  the  precise  form  of  the  cenlre-furround  neighbourhood* 
vary  between  ipeciei.  Call  have  simple  circular  receptive  fields,  whilst  rabbits  have  gangUon 
cells  with  receptive  fields  sensitive  to  lines  and  motion  in  specific  directions.  Surprisingly, 
frogs  and  toads  appear  to  perform  the  most  retinol  processing.  They  use  gong^on  cells 
tuned  to  one  of  several  specific  stimuli,  including  some  which  ore  so  specific  they  appear  to 
be  'bug*  detectors[l6].  It  appears  that  in  higher  animals  most  of  the  detailed  interpretation 
of  the  information  is  performed  in  the  higher  centres  of  the  brain,  where  input  from  other 
sensory  systems  con  be  used  to  assist  any  interpretation.  The  retina  of  higher  vertebrates 
may  therefore  represent  the  result  of  a  desire  to  compress  data,  without  prejudicing  later 
interpretation  by  assuming  too  much  prior  knowledge. 

The  next  question  to  consider  is:  How  ore  these  receptive  fields  organised  from  the 
other  cell  populations  in  the  retina?  In  describing  the  complex  connectivity  within  the 
retina  the  best  starting  point  Is  the  photoreceptor  cells,  which  react  light  falling  on  their 
$urface[l4].  The  Bipolar  cells  which  receive  input  direct  from  the  photoreceptors  cells  have 
been  found  to  possess  concentric  antagonistic  centre-surrounds.  The  centres  of  the  receptive 
fields  ore  supplied  directly  by  the  photoreceptors,  whilst  the  horirontol  cells  supply  the 
surrounds.  Tlt<  mechanism  by  which  the  horizontal  cells  affect  the  bipolar  cell  response  has 
been  studied  by  Werblin(l7].  Werblin  demonstrated  that  the  horizontal  cells  mediated  the 
bipolar  cell  response  by  correlating  the  activity  in  the  horizontal  cells  with  the  adaptation 
of  the  bipolar  cells.  By  examining  the  response  of  a  horizontal  cell  to  a  point  stimulus 
it  has  been  demonstrated  that  the  influence  of  a  receptor  on  the  horizontal  cell  decays 
exponentially  with  distance  from  the  stimulus.  This  behaviour,  together  with  the  numerous 
gap  junctions  between  the  horizontal  cells,  suggests  that  the  function  of  these  cells  is  to  act 
like  a  resistive  network.  The  mechanism  underlying  the  influence  of  horizontal  cells  on  the 
bipolar  cells  was  not  identified  by  Werblin.  However,  he  was  able  to  demonstrate  that  the 
affect  of  the  horizontal  cells  was  to  subtract  from  the  stimulus  of  the  bipolar  cell  before  the 
rod  to  bipolar  cell  synapse.  This  implicates  the  triad  synapse,  shown  in  figure  (lb),  where 
the  rod,  bipolar  and  horizontal  cells  have  neighbouring  synapses,  in  the  mechanism.  The 
fact  that  the  horizontal  cells  do  not  adapt  with  the  bipolar  cells  suggest  that  the  horizontal 
cells  are  stimulated  directly  by  the  receptor  cell  population.  The  effect  of  the  horizontal  cells 
is  a  shift  in  the  sensitivity  of  the  bipolar  cells  to  the  level  of  illumination  of  the  surround  of 
its  receptive  field.  Then  the  bipolar  cell  responds  to  central  illumination  levels  which  differ 
by  one  decade  in  intensity  in  this  surrounding  level.  The  bipolar  cell  therefore  encodes  a 
measure  of  the  contrast  between  the  centre  and  the  surround. 

Werblin[3]  found  that  he  could  study  the  antagonistic  centre-surround  using  uniform 
illumination  because  the  effect  of  the  surround  is  delayed  by  200ms  compared  with  the 
effect  of  the  centre.  Using  this  technique  he  found  that  at  low  levels  of  illumination  the 
ganglion  cells  responded  directly  to  the  receptor  cells,  via  the  bipolar  cells.  The  horizontal 
cells,  which  mediate  the  antagonistic  centre-surround  organisation  only  affected  the  bipolar 
cells,  and  hence  the  ganglion  cells  at  high  levels  of  background  illumination.  This  is  contrary 
to  a  prediction,  based  upon  the  predictive  encoding  hypothesis,  in  section  2. 
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5  The  Horsc-shoc  Crab  Lateral  Eye 


The  compound  eye*  of  the  horie»hoe*cr«b,  LimuJut  Polyphemui,  h*ve  been  itudied  for  over 
50  ye&ri  Since  thli  ipeciei  ii  m  Isolated  example  of  the  use  of  compound  eyes  within  its 
group,  these  eyes  arc  extremely  atypical.  In  fact  each  Limulus  has  several  structures  which 
(u-e  photosensitive  and  could  be  termed  eyes.  The  present  discussion  will  concentrate  on  the 
lateral  eyes,  which  are  apposition  compound  eyes  used  by  nudes  to  detect  females  during 
mating. 

Examination  of  the  lateral  eyes  has  shown  that  each  onunatidium  contains  a  group  of 
10-13  photosensitive  retinula  cells.  The  ceils  coruiect  to  the  eccentric  cell,  a  modified 
retinula  unique  to  the  Limulut  retina,  which  forms  the  output.  These  output  neurons  from 
the  ommatidia  then  form  the  plexus,  an  open  meshwork  of  retinular  and  eccentric  neurons 
together  with  some  efferent  axons(l9].  Although  the  eccentric  cells  form  the  output  from 
these  eyes,  they  do  not  generate  action  potentials  until  they  have  traversed  the  plexus. 

In  the  earliest  experiments  it  became  evident  that  the  retina  performed  a  great  deal  of 
sophisticated  ‘data  processing*  [19,  20].  Initially,  the  neurons  were  expected  to  act  indepen* 
dently  and  inhibitory  behaviour  between  neurons  was  only  discovered,  by  accident,  when 
it  was  noted  that  stray  laboratory  light  usually  caused  a  decrease  rather  than  an  increase 
in  neural  activity.  This  effect  is  now  known  to  be  caused  by  inhibitory  inputs,  from  the 
receptors  stimulated  by  the  stray  light  influencing  the  receptor  under  investigation.  More 
detailed  studies  have  indicated  that  the  inhibition  is  not  instantaneous.  This  delay  in  the 
onset  of  inhibition  is  critical  in  the  widespread  occurrence  in  neurons  of  ‘on*  transient  bursts 
of  activlty[19].  These  bursts  arise  because  the  direct  stimulus  of  the  cell  generates  an  in¬ 
creased  activity  which  is  later  decreased  by  the  delayed  Inhibition.  Once  the  stimulus,  and 
hence  the  inhibition,  is  removed  post-inhibitory  rebound  in  the  neuron  generates  an  'off* 
burst  of  activity. 

Experiments  and  simulations  indicate  that  the  inhibition  caused  by  a  neuron  depends 
upon  its  potential  after  it  has  itself  been  inhibited.  The  result  is  that  the  inhibition  ex¬ 
perienced  by  an  neuron  depends  upon  the  inhibition  it  has  generated  in  a  neighbour.  In 
an  attempt  to  uncover  the  mechanism  underlying  this  recurrent  inhibition  Fahrenbach[2l] 
has  studied  the  synaptic  connections  in  the  plexus.  His  results  indicate  that  the  inhibition 
is  mediated  by  synapses  between  collaterals  of  eccentric  cells,  with  a  synaptic  connectivity 
determined  by  a  stochsutic  process.  This  makes  describing  and  then  interpreting  the  plexus 
network  very  difficult.  The  stochastic  connection  rules  could  only  be  revealed  by  detailed 
studies  of  several  neurons.  In  general  the  synapses  occur  at  the  terminal  arborisations,  with 
input  and  output  neurons  intermingling.  The  total  number  of  output  synapses  appeared 
to  be  independent  of  the  distance  of  the  arborisation  from  the  parent  axon.  On  the  con¬ 
trary  the  output  synapse  density  decreases  with  increased  distance  of  the  arborisation  from 
the  parent,  13%  of  the  nearest  arborisations  contained  38%  of  the  synapses.  These  results 
suggests  that  the  stochastic  connection  rule  leads  to  the  influence  of  a  neuron  decreasing 

“These  studies  htve  been  so  suecesthd  that  the  neural  network  in  the  Kmnlas  compound  eye  is  one  of 
(he  few  neural  networks  that  have  been  modeled  exactlr(18}.  The  equations  that  describe  the  response  of 
individual  oiTimstidJa  eye  to  static  and  moving  images  have  been  available  (br  twenty  years.  With  the  recent 
advent  of  suitable  computers,  in  this  ease  a  connection  machine,  (he  response  of  an  array  of  ommatidia  can 
be  simulated.  These  simulations  demonstrate  (hat  the  eyes  are  tuned  to  identify  other  Borseshoc  crabs.  A 
result  which  agrees  with  the  behavioural  experiments  which  demonstrated  that  the  eyes  arc  only  used  to 
locate  a  mate. 
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with  incrcAicd  cUstunce  from  the  neuron.  Thu*  a  very  different  meduuiiim  I*  employed  to 
achieve  the  effect  obtained  from  a  rciiitive  grid  in  the  previoui  (wo  retinae. 

6  Potential  Lessons 


In  each  of  the  preceeding  three  leetion  we  have  ditcufted  a  different  retina.  Deipite  the 
fact  that  there  retinai  repretent  three  independently  evolved  ayetemi,  itriking  limilaritiet 
emerge: 


e  AU  the  systcmi  uie  analog  potentialt  to  represent  and  manipulate  information  until 
it  it  communicated  over  long  dittancei  to  the  rest  of  the  brain.  It  it  only  at  this  stage 
that  it  is  encoded  using  action  potentials. 

•  There  it  widespread  use  of  lateral  inhibition  to  form  antagonistic  cent  re*  surround 
receptive  fields.  The  fact  that  there  are  a  variety  of  interpretations  of  the  function 
of  this  feature  simple  demonstrates  the  potential  usefulness  of  this  organisational, 
principle. 

--  •  Antagonistic  centre-surround  receptive  fields  give  sufficient  evolutionary  advantage 
that  three  different  strategies  have  evolved  to  generate  these  receptive  fields;  The 
fly  lamina  generates  a  local  potential  in  the  glial  cells  which  is  subtracted  from  the 
signal  by  a  change  of  reference.  In  the  vertebrate  retina  the  horizontal  cells  form  the 
resistive  network,  influencing  the  other  information  processing  via  a  chemical  synapse. 
Whilst,  the  strangest  neural  implementation  is  the  stochastic  connection  probability 
employed  in  by  Limulus. 

•  All  the  retinas  trade  speed  for  accuracy  at  low  levels  of  illumination  by  extending  the 
neural  integration  time. 

•  Inhibition  is  delayed  to  allow  an  on-burst  of  activity  with  a  corresponding  off-burst 
caused  by  post-inhibitory  rebound. 


It  has  been  suggested  by  Laughlin  and  co-workers  that  predictive  encoding  is  the  princi¬ 
ple  underlying  the  widespread  use  of  lateral  inhibition,  in  particiilar,  in  antagonistic  centre- 
surround.  Unfortimately  the  theory,  proposed  in  1982,  has  not  developed  in  light  of  more 
recent  experimental  results.  A  consequence  of  this  is  that  in  some  situations  the  theory  fails 
some  of  the  tests  proposed  when  it  was  originally  developed.  In  particular,  as  discussed  in 
section  4,  the  receptive  fields  in  the  vertebrate  retina  have  been  found  to  contract[3]  as  the 
overall  level  of  illumination  decreases,  rather  than  expand  to  calculate  a  'global'  mean  as 
originally  predicted{5].  Closer  examination  of  the  original  work  suggests  that  this  is  not  a 
failure  in  the  underlying  theory,  but  arises  from  the  use  of  incorrect  assumptions.  In  the 
original  work  it  was  assumed  that  predictive  encoding  would  be  used  under  all  conditions. 
More  recent  studies  suggests  that  predictive  encoding  is  only  used  to  reduce  the  dynamic 
range  of  signals  if  the  signal  would  otherwise  exceed  the  limitations  imposed  by  the  'wet- 
ware'.  This  explains  the  lack  of  lateral  Inhibition  at  the  low  levels  of  illumination  which 
would  not  be  affected  by  the  limited  dynamic  range  in  the  neurons.  IT  this  is  correct  then, 
despite  the  errors  in  its  original  formulation[5},  the  predictive  encoding  hypothesis  iq>pears 
to  represent  the  best  theory  for  the  information  processing  which  occurs  in  retinas.  Any 


Kubicqurnt  theory  must  retain  one  of  the  features  of  the  hypothesis.  The  desired  informa¬ 
tion  processing  must  be  independent  of  the  scene.  It  is  this  attribute  which  enables  the 
hypothesis  to  explain  the  ‘hardwiring*  of  the  antagonistic  centre-surrounds. 

Results  from  studies  of  vertebrate  colour  vision  suggest  that  lateral  inhibition  can  be 
used  to  remove  other  correlations  from  signals.  Colour  vision  it  due  to  pigments  in  the 
cones{l6].  A  tingle  pigment  would  not  enable  unique  determination  of  colour.  This  requires 
at  least  two  pigments,  in  fact  three  pigments,  red,  green  and  blue,  operating  with  overlapping 
bands  are  used.  Colour  it  then  perceived  as  the  relative  activities  of  cones  with  these 
different  pigments.  It  appears  these  relative  activities  are  encoded  by  gan«,Uon  cells  using 
antagonism.  In  the  simplest  cate  of  colour  coding  a  receptive  field  it  organised  to  be 
stimulated  by  one  colour  at  the  centre  and  iithlbited  by  another  colour  in  the  surround.  The 
resulting  signal  it  then  the  difference  between  the  response  of  cells  with  different  pigments. 
The  colour  vision  system  with  three  overlapping  sensors  is  a  smaller  version  of  another 
sensory  system,  the  olfactory  system,  which  alto  uses  a  range  of  sensors  with  overlapping 
responses.  In  fact  Shepherd  claims  a  correspondence  between  the  retina  and  the  olfactory' 
bulb[l6].  If  this  correspondence  it  correct  then  it  suggests  that  the  olfactory  bulb  and  the 
retina  employ  the  tame  information  processing  strategy.  This  would  strongly  suggest  that 
the  strategy  employed  within  retinas  to  overcome  the  limited  dynamic  range  of  neurons  it 
generally  applied  within  neural  systems. 

There  are  several  Important  facts  which  emerge  directly  relevant  to  the  design  of  artificial 
analogue  neural  networks. 

•  Lateral  inhibition  is  used  extensively  to  reduce  the  dynamic  range  needed  to  represent 
information.  The  theory  which  has  been  proposed  by  Srinivasan,  Laughlin  and  Dubs 
suggests  that  the  lateral  inhibition  is  used  to  remove  predictable  correlations  from  the 
data. 

e  The  dynamic  range  of  the  signal  should  be  reduced  as  soon  as  possible.  This  should 
be  followed  by  amplification  to  increase  robustness  to  noise. 

•  The  amplification  process  should  be  non-linear  and  matched  to  the  expected  signal 
statistics  in  an  attempt  to  use  each  signal  level  equally  often. 

•  Considerable  effort  is  employed  within  the  fly  lamina  to  ensure  that  related  data  is 
present  locally  to  reduce  length  of  any  signal  paths.  If  this  is  a  general  feature  of  bio¬ 
logical  neural  systems  then  the  different  centres  in  the  brain  may  be  related  to  different 
spatial  distributions,  representations,  of  the  Information.  Each  representation  could 
then  emphasise  different  possible  correlations  in  the  information  with  transformations 
between  representations  occurring  during  the  projection  of  axons  between  centres. 
These  projections  employ  robust  pulse  coding  of  information  so  that  information  can 
be  transmitted  over  long  distances  without  being  corrupted. 

•  The  fly  and  vertebrate  retinas[22]  employ  two  parallel  detector  systems  with  different 
sensitivities.  The  coupling  between  the  two  sensor  systems  which  occurs  in  both  of 
these  retinas  suggest  that  the  more  sensitive  system  automatically  activates  the  other 
system  once  it  becomes  saturated. 

Finally,  this  studies  emphasises  that  information  processing  can  ocettf  within  a  neural 
network  without  a  single  action  potential  initiation.  This  demonstrates  the  limited  nature  of 
the  McCulloch-  Pitt  model  of  the  neuron  which  forms  the  basis  of  arttfleial  neural  networks. 
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A  Alternative  theory:  Retinal  Gain  Control 

In  (hit  Appendix  retinAl  gain  control  it  ditcuited  as  a  theory  for  AdAptAtion.  This  theory 
it  not  At  complete  At  the  predictive  encoding  theory  ditcuited  in  the  body  of  the  text.  It 
Alto  AppcArt  to  be  incorrect  At  An  expInnAtion  of  retinAl  function.  However,  when  contider- 
ing  techniquet  which  ton  be  utefuUy  Implemented  in  Anelogue  neurnl  networks,  biologicAl 
currectnett  it  irrelevAnt.  The  technique  It  therefore  included  for  completeneit. 

In  1984  ShApley  And  Enioth-Cugell  published  a  pAper  in  which  they  suggested  tbet  gein 
control  within  the  retinA  was  a  sufficient  bAtis  to  expUin  iMlAptAtion(23i.  This  new  theory 
WAS  proposed  becAute  the  Authors  thought  thAt  predictive  encoding  mey  not  be  robust  when 
Applied  to  A  lyttem  in  motion,  such  At  An  eye.  At  with  predictive  encoiUng  the  motivAtion  it 
to  mAintAin  retinAl  response  to  contrASt  independent  of  the  Amount  of  bAckgrouiid  illuihinA- 
tion.  This  enAbles  the  retinA  to  chATACterise  objects  by  their  reflectAnces.  In  psychophysicAl 
experiments  it  it  found  thAt  the  AppArent  brightness  of  An  object  depends  upon  the  border 
contrASt.  This  observAtion  AppeArt  to  be  the  stArting  point  from  which  this  theory  was 
developed.  UnfortunAtely  it  it  not  cleAr  if  this  fAct  could  be  expleined  by  predictive  coding. 

To  begin  it  is  postuleted  thAt  the  retinAl  AdAptAtion  process  depends  upon  eye  motion. 
Under  these  conditions  if  a  receptor  it  viewing  the  ‘bAckground*  And  moves  Across  a  bound- 
ary  it  can  respond  to  changes  in  the  signal.  This  response  can  then  be  Amplified.  Retinal 
gain  control  suggests  that  if  the  gain  of  the  amplification  process  it  inversely  proportional  to 
the  original  illumination,  the  amplified  signal  is  proportional  to  the  contrast  at  the  bound¬ 
ary  independent  of  the  overall  illumination;  i.e.  adaptation  depends  upon  a  gain  which 
changes  with  the  level  of  illumination.  Experimentally  the  required  type  of  behaviour  was 
found  in  some  species  but  not  in  all.  The  authors  Attempted  to  verify  their  theory  using 
results  from  different  parts  of  various  vertebrate  retinas.  This  casts  doubt  on  the  validity 
of  their  results  since  as  the  authors  themselves  note  results  from  one  species  may  not  be 
valid  for  others. 

In  studies  of  the  fly  retina,  Laughlin  and  co-workers  found  that,  at  the  highest  levels  of 
illumination,  the  gain  of  the  photoreceptor  to  LMC  synapses  were  constant,  independent 
of  the  level  of  illumination[l2].  The  only  adaptation  reported  ensured  that  the  synapse 
operates  in  the  regime  in  which  it  can  employ  maximum  gsdn.  These  results  appear  to  cast 
doubt  upon  the  use  of  gain  control  as  an  adaptation  mechanism  in  retinas. 

Overall  it  is  not  clear  if  this  theory  can  withstand  scrutiny  as  an  explanation  of  retina 
behaviour,  however,  it  may  still  be  applicable  in  an  artificial  system. 
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